Mobile terminal and controlling method thereof

ABSTRACT

A mobile terminal and controlling method thereof are disclosed. The present invention includes displaying a 3D user interface including at least one 3D object on a display unit, selecting at least one stereoscopic region from the 3D user interface by a first input via a user input unit, displaying at least one polyhedron corresponding to each of the selected at least one region on the display unit, and changing a display state of each of the at least one polyhedron to correspond to a second input via the user input unit, wherein the step of changing the display state is performed to enlarge, reduce, rotate or scroll the at least one polyhedron according to the second input. Accordingly, the present invention provides a 3D user interface using a 3D object arranged in a virtual 3D space, thereby facilitating a user to manipulate a mobile terminal with a new visual effect.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority from Korean Application No.10-2010-0084648, filed Aug. 31, 2010, the subject matter of which isincorporated herein by reference.

BACKGROUND

1. Field

The present invention relates to a mobile terminal, and moreparticularly, to a mobile terminal and controlling method thereof.Although the present invention is suitable for a wide scope ofapplications, it is particularly suitable for providing functions ofenlargement, reduction and rotation to a 3D user interface 3D userinterface.

2. Background

Generally, terminals can be classified into mobile/portable terminalsand stationary terminals. The mobile terminals can be classified intohandheld terminals and vehicle mount terminals again according topossibility of user's direct portability.

As functions of the terminal are diversified, the terminal isimplemented as a multimedia player provided with composite functionssuch as photographing of photos or moving pictures, playback of music ormoving picture files, game play, broadcast reception and the like forexample.

To support and increase of the terminal functions, it may be able toconsider the improvement of structural parts and/or software parts ofthe terminal.

Recently, as various 3-dimensional (hereinafter abbreviated 3D) userinterfaces can be implemented on a display unit of a terminal using 3Dobjects, the demands for manipulating methods convenient for performinga display form change (e.g., enlargement, reduction, rotation, etc.) ofa 3D user interface are ongoing to rise.

BRIEF DESCRIPTION OF THE DRAWINGS

The embodiments will be described in detail with reference to thefollowing drawings in which like reference numerals refer to likeelements wherein:

FIG. 1 is a block diagram of a mobile terminal according to oneembodiment of the present invention;

FIG. 2 is a front perspective diagram of a mobile terminal according toone embodiment of the present invention;

FIG. 3 is a front diagram of a mobile terminal according to oneembodiment of the present invention to describe one operative statusthereof;

FIG. 4 is a diagram for describing the principle of binocular disparity;

FIG. 5 is a flowchart for one example of a method of controlling a 3Duser interface implemented in a mobile terminal according to oneembodiment of the present invention;

FIG. 6 is a diagram for one example of a display form of a 3D userinterface implemented in a mobile terminal according to one embodimentof the present invention;

FIG. 7 is a diagram for one example of a change region polyhedron formdisplayed if a prescribed region of a 3D user interface displayed on amobile terminal according to one embodiment of the present invention isdesignated to a display state change region;

FIG. 8 is a diagram for one example of a method of designating a displaystate change region to a 3D user interface according to one embodimentof the present invention;

FIG. 9 is a diagram for one example of a form of displaying a changeregion polyhedron on a 3D user interface in a mobile terminal accordingto one embodiment of the present invention;

FIG. 10 is a diagram for one example of a method of scrolling a changeregion polyhedron in a mobile terminal according to one embodiment ofthe present invention;

FIG. 11 is a diagram for one example of a method of rotating a changeregion polyhedron in a mobile terminal according to one embodiment ofthe present invention;

FIG. 12 is a diagram for one example of a method of enlarging/reducing achange region polyhedron in a mobile terminal according to oneembodiment of the present invention;

FIG. 13 is a diagram for one example of manipulating a change regionpolyhedron via a touch input in a mobile terminal according to oneembodiment of the present invention;

FIG. 14 is a diagram for one example of a method of enlarging anddisplaying one facet of a chance region polyhedron in a mobile terminalaccording to one embodiment of the present invention;

FIG. 15 is a diagram for one example of a method of selecting aplurality of display state change regions in a mobile terminal accordingto another embodiment of the present invention; and

FIG. 16 is a diagram for one example of a form of displaying a pluralityof change region polyhedrons in a mobile terminal according to anotherembodiment of the present invention.

DETAILED DESCRIPTION

In the following detailed description, reference is made to theaccompanying drawing figures which form a part hereof, and which show byway of illustration specific embodiments of the invention. It is to beunderstood by those of ordinary skill in this technological field thatother embodiments may be utilized, and structural, electrical, as wellas procedural changes may be made without departing from the scope ofthe present invention. Wherever possible, the same reference numberswill be used throughout the drawings to refer to the same or similarparts.

As used herein, the suffixes ‘module’, ‘unit’ and ‘part’ are used forelements in order to facilitate the disclosure only. Therefore,significant meanings or roles are not given to the suffixes themselvesand it is understood that the ‘module’, ‘unit’ and ‘part’ can be usedtogether or interchangeably.

The present invention can be applicable to a various types of terminals.Examples of such terminals include mobile as well as stationaryterminals, such as mobile phones, user equipment, smart phones, DTV,computers, digital broadcast terminals, personal digital assistants,portable multimedia players (PMP) and navigators.

However, by way of non-limiting example only, further description willbe with regard to a mobile terminal 100, and it should be noted thatsuch teachings may apply equally to other types of terminals.

FIG. 1 is a block diagram of a mobile terminal 100 in accordance with anembodiment of the present invention. FIG. 1 shows the mobile terminal100 according to one embodiment of the present invention includes awireless communication unit 110, an A/V (audio/video) input unit 120, auser input unit 130, a sensing unit 140, an output unit 150, a memory160, an interface unit 170, a controller 180, a power supply unit 190and the like. FIG. 1 shows the mobile terminal 100 having variouscomponents, but it is understood that implementing all of theillustrated components is not a requirement. Greater or fewer componentsmay alternatively be implemented.

In the following description, the above elements of the mobile terminal100 are explained in sequence.

First of all, the wireless communication unit 110 typically includes oneor more components which permits wireless communication between themobile terminal 100 and a wireless communication system or networkwithin which the mobile terminal 100 is located. For instance, thewireless communication unit 110 can include a broadcast receiving module111, a mobile communication module 112, a wireless Internet module 113,a short-range communication module 114, a position-location module 115and the like.

The broadcast receiving module 111 receives a broadcast signal and/orbroadcast associated information from an external broadcast managingserver via a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrialchannel.

The broadcast managing server generally refers to a server whichgenerates and transmits a broadcast signal and/or broadcast associatedinformation or a server which is provided with a previously generatedbroadcast signal and/or broadcast associated information and thentransmits the provided signal or information to a terminal. Thebroadcast signal may be implemented as a TV broadcast signal, a radiobroadcast signal, and a data broadcast signal, among others. If desired,the broadcast signal may further include a broadcast signal combinedwith a TV or radio broadcast signal.

The broadcast associated information includes information associatedwith a broadcast channel, a broadcast program, a broadcast serviceprovider, etc. And, the broadcast associated information can be providedvia a mobile communication network. In this case, the broadcastassociated information can be received by the mobile communicationmodule 112.

The broadcast associated information can be implemented in variousforms. For instance, broadcast associated information may include anelectronic program guide (EPG) of digital multimedia broadcasting (DMB)and electronic service guide (ESG) of digital video broadcast-handheld(DVB-H).

The broadcast receiving module 111 may be configured to receivebroadcast signals transmitted from various types of broadcast systems.By nonlimiting example, such broadcasting systems include digitalmultimedia broadcasting-terrestrial (DMB-T), digital multimediabroadcasting-satellite (DMB-S), digital video broadcast-handheld(DVB-H), the data broadcasting system known as media forward link only(MediaFLO®) and integrated services digital broadcast-terrestrial(ISDB-T). Optionally, the broadcast receiving module 111 can beconfigured suitable for other broadcasting systems as well as theabove-explained digital broadcasting systems.

The broadcast signal and/or broadcast associated information received bythe broadcast receiving module 111 may be stored in a suitable device,such as a memory 160.

The mobile communication module 112 transmits/receives wireless signalsto/from one or more network entities (e.g., base station, externalterminal, server, etc.). Such wireless signals may represent audio,video, and data according to text/multimedia message transceivings,among others.

The wireless internet module 113 supports Internet access for the mobileterminal 100. This module may be internally or externally coupled to themobile terminal 100. In this case, the wireless Internet technology caninclude WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax(World Interoperability for Microwave Access), HSDPA (High SpeedDownlink Packet Access), etc.

The short-range communication module 114 facilitates relativelyshort-range communications. Suitable technologies for implementing thismodule include radio frequency identification (RFID), infrared dataassociation (IrDA), ultra-wideband (UWB), as well at the networkingtechnologies commonly referred to as Bluetooth and ZigBee, to name afew.

The position-location module 115 identifies or otherwise obtains thelocation of the mobile terminal 100. If desired, this module may beimplemented with a global positioning system (GPS) module.

Referring to FIG. 1, the audio/video (NV) input unit 120 is configuredto provide audio or video signal input to the mobile terminal 100. Asshown, the A/V input unit 120 includes a camera 121 and a microphone122. The camera 121 receives and processes image frames of stillpictures or video, which are obtained by an image sensor in a video callmode or a photographing mode. And, the processed image frames can bedisplayed on the display 151.

The image frames processed by the camera 121 can be stored in the memory160 or can be externally transmitted via the wireless communication unit110. Optionally, at least two cameras 121 can be provided to the mobileterminal 100 according to environment of usage.

The microphone 122 receives an external audio signal while the portabledevice is in a particular mode, such as phone call mode, recording modeand voice recognition. This audio signal is processed and converted intoelectric audio data. The processed audio data is transformed into aformat transmittable to a mobile communication base station via themobile communication module 112 in case of a call mode. The microphone122 typically includes assorted noise removing algorithms to removenoise generated in the course of receiving the external audio signal.

The user input unit 130 generates input data responsive to usermanipulation of an associated input device or devices. Examples of suchdevices include a keypad, a dome switch, a touchpad (e.g., staticpressure/capacitance), a jog wheel, a jog switch, etc.

The sensing unit 140 provides sensing signals for controlling operationsof the mobile terminal 100 using status measurements of various aspectsof the mobile terminal. For instance, the sensing unit 140 may detect anopen/close status of the mobile terminal 100, relative positioning ofcomponents (e.g., a display and keypad) of the mobile terminal 100, achange of position of the mobile terminal 100 or a component of themobile terminal 100, a presence or absence of user contact with themobile terminal 100, orientation or acceleration/deceleration of themobile terminal 100.

As an example, consider the mobile terminal 100 being configured as aslide-type mobile terminal. In this configuration, the sensing unit 140may sense whether a sliding portion of the mobile terminal is open orclosed. Other examples include the sensing unit 140 sensing the presenceor absence of power provided by the power supply 190, the presence orabsence of a coupling or other connection between the interface unit 170and an external device. And, the sensing unit 140 can include aproximity sensor 141.

The output unit 150 generates outputs relevant to the senses of sight,hearing, touch and the like. And, the output unit 150 includes thedisplay 151, an audio output module 152, an alarm unit 153, a hapticmodule 154, a projector module 155 and the like.

The display 151 is typically implemented to visually display (output)information associated with the mobile terminal 100. For instance, ifthe mobile terminal is operating in a phone call mode, the display willgenerally provide a user interface (UI) or graphical user interface(GUI) which includes information associated with placing, conducting,and terminating a phone call. As another example, if the mobile terminal100 is in a video call mode or a photographing mode, the display 151 mayadditionally or alternatively display images which are associated withthese modes, the UI or the GUI.

The display module 151 may be implemented using known displaytechnologies including, for example, a liquid crystal display (LCD), athin film transistor-liquid crystal display (TFT-LCD), an organiclight-emitting diode display (OLED), a flexible display and athree-dimensional display. The mobile terminal 100 may include one ormore of such displays.

Some of the above displays can be implemented in a transparent oroptical transmissive type, which can be named a transparent display. Asa representative example for the transparent display, there is TOLED(transparent OLED) or the like. A rear configuration of the display 151can be implemented in the optical transmissive type as well. In thisconfiguration, a user is able to see an object in rear of a terminalbody via the area occupied by the display 151 of the terminal body.

At least two displays 151 can be provided to the mobile terminal 100 inaccordance with the implemented configuration of the mobile terminal100. For instance, a plurality of displays can be arranged on a singleface of the mobile terminal 100 in a manner of being spaced apart fromeach other or being built in one body. Alternatively, a plurality ofdisplays can be arranged on different faces of the mobile terminal 100.

In case that the display 151 and a sensor for detecting a touch action(hereinafter called ‘touch sensor’) configures a mutual layer structure(hereinafter called ‘touchscreen’), it is able to use the display 151 asan input device as well as an output device. In this case, the touchsensor can be configured as a touch film, a touch sheet, a touchpad orthe like.

The touch sensor can be configured to convert a pressure applied to aspecific portion of the display 151 or a variation of a capacitancegenerated from a specific portion of the display 151 to an electricinput signal. Moreover, it is able to configure the touch sensor todetect a pressure of a touch as well as a touched position or size.

If a touch input is made to the touch sensor, signal(s) corresponding tothe touch is transferred to a touch controller. The touch controllerprocesses the signal(s) and then transfers the processed signal(s) tothe controller 180. Therefore, the controller 180 is able to knowwhether a prescribed portion of the display 151 is touched.

Referring to FIG. 1, a proximity sensor (not shown in the drawing) canbe provided to an internal area of the mobile terminal 100 enclosed bythe touchscreen or around the touchscreen. The proximity sensor is thesensor that detects a presence or non-presence of an object approachinga prescribed detecting surface or an object existing around theproximity sensor using an electromagnetic field strength or infrared raywithout mechanical contact. Hence, the proximity sensor has durabilitylonger than that of a contact type sensor and also has utility widerthan that of the contact type sensor.

The proximity sensor can include one of a transmissive photoelectricsensor, a direct reflective photoelectric sensor, a mirror reflectivephotoelectric sensor, a radio frequency oscillation proximity sensor, anelectrostatic capacity proximity sensor, a magnetic proximity sensor, aninfrared proximity sensor and the like. In case that the touchscreenincludes the electrostatic capacity proximity sensor, it is configuredto detect the proximity of a pointer using a variation of electric fieldaccording to the proximity of the pointer. In this case, the touchscreen(touch sensor) can be classified as the proximity sensor.

In the following description, for clarity, an action that a pointerapproaches without contacting with the touchscreen to be recognized aslocated on the touchscreen is named ‘proximity touch’. And, an actionthat a pointer actually touches the touchscreen is named ‘contacttouch’. The meaning of the position on the touchscreen proximity-touchedby the pointer means the position of the pointer which verticallyopposes the touchscreen when the pointer performs the proximity touch.

The proximity sensor detects a proximity touch and a proximity touchpattern (e.g., a proximity touch distance, a proximity touch duration, aproximity touch position, a proximity touch shift state, etc.). And,information corresponding to the detected proximity touch action and thedetected proximity touch pattern can be outputted to the touchscreen.

The audio output module 152 functions in various modes including acall-receiving mode, a call-placing mode, a recording mode, a voicerecognition mode, a broadcast reception mode and the like to outputaudio data which is received from the wireless communication unit 110 oris stored in the memory 160. During operation, the audio output module152 outputs audio relating to a particular function (e.g., callreceived, message received, etc.). The audio output module 152 is oftenimplemented using one or more speakers, buzzers, other audio producingdevices, and combinations thereof.

The alarm unit 153 is output a signal for announcing the occurrence of aparticular event associated with the mobile terminal 100. Typical eventsinclude a call received event, a message received event and a touchinput received event. The alarm unit 153 is able to output a signal forannouncing the event occurrence by way of vibration as well as video oraudio signal. The video or audio signal can be outputted via the display151 or the audio output unit 152. Hence, the display 151 or the audiooutput module 152 can be regarded as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that can besensed by a user. Vibration is a representative one of the tactileeffects generated by the haptic module 154. Strength and pattern of thevibration generated by the haptic module 154 are controllable. Forinstance, different vibrations can be outputted in a manner of beingsynthesized together or can be outputted in sequence.

The haptic module 154 is able to generate various tactile effects aswell as the vibration. For instance, the haptic module 154 generates theeffect attributed to the arrangement of pins vertically moving against acontact skin surface, the effect attributed to the injection/suctionpower of air though an injection/suction hole, the effect attributed tothe skim over a skin surface, the effect attributed to the contact withelectrode, the effect attributed to the electrostatic force, the effectattributed to the representation of hold/cold sense using an endothermicor exothermic device and the like.

The haptic module 154 can be implemented to enable a user to sense thetactile effect through a muscle sense of finger, arm or the like as wellas to transfer the tactile effect through a direct contact. Optionally,at least two haptic modules 154 can be provided to the mobile terminal100 in accordance with the corresponding configuration type of themobile terminal 100.

The projector module 155 is the element for performing an imageprojector function using the mobile terminal 100. And, the projectormodule 155 is able to display an image, which is identical to orpartially different at least from the image displayed on the display151, on an external screen or wall according to a control signal of thecontroller 180.

In particular, the projector module 155 can include a light source (notshown in the drawing) generating light (e.g., laser) for projecting animage externally, an image producing means (not shown in the drawing)for producing an image to output externally using the light generatedfrom the light source, and a lens (not shown in the drawing) forenlarging to output the image externally in a predetermined focusdistance. And, the projector module 155 can further include a device(not shown in the drawing) for adjusting an image projected direction bymechanically moving the lens or the whole module.

The projector module 155 can be classified into a CRT (cathode ray tube)module, an LCD (liquid crystal display) module, a DLP (digital lightprocessing) module or the like according to a device type of a displaymeans. In particular, the DLP module is operated by the mechanism ofenabling the light generated from the light source to reflect on a DMD(digital micro-mirror device) chip and can be advantageous for thedownsizing of the projector module 151.

Preferably, the projector module 155 can be provided in a lengthdirection of a lateral, front or backside direction of the mobileterminal 100. And, it is understood that the projector module 155 can beprovided to any portion of the mobile terminal 100 according to thenecessity thereof.

The memory unit 160 is generally used to store various types of data tosupport the processing, control, and storage requirements of the mobileterminal 100. Examples of such data include program instructions forapplications operating on the mobile terminal 100, contact data,phonebook data, messages, audio, still pictures, moving pictures, etc.And, a recent use history or a cumulative use frequency of each data(e.g., use frequency for each phonebook, each message or eachmultimedia) can be stored in the memory unit 160. Moreover, data forvarious patterns of vibration and/or sound outputted in case of a touchinput to the touchscreen can be stored in the memory unit 160.

The memory 160 may be implemented using any type or combination ofsuitable volatile and non-volatile memory or storage devices includinghard disk, random access memory (RAM), static random access memory(SRAM), electrically erasable programmable read-only memory (EEPROM),erasable programmable read-only memory (EPROM), programmable read-onlymemory (PROM), read-only memory (ROM), magnetic memory, flash memory,magnetic or optical disk, multimedia card micro type memory, card-typememory (e.g., SD memory, XD memory, etc.), or other similar memory ordata storage device. And, the mobile terminal 100 is able to operate inassociation with a web storage for performing a storage function of thememory 160 on Internet.

The interface unit 170 is often implemented to couple the mobileterminal 100 with external devices. The interface unit 170 receives datafrom the external devices or is supplied with the power and thentransfers the data or power to the respective elements of the mobileterminal 100 or enables data within the mobile terminal 100 to betransferred to the external devices. The interface unit 170 may beconfigured using a wired/wireless headset port, an external chargerport, a wired/wireless data port, a memory card port, a port forcoupling to a device having an identity module, audio input/outputports, video input/output ports, an earphone port and/or the like.

The identity module is the chip for storing various kinds of informationfor authenticating a use authority of the mobile terminal 100 and caninclude User Identify Module (UIM), Subscriber Identify Module (SIM),Universal Subscriber Identity Module (USIM) and/or the like. A devicehaving the identity module (hereinafter called ‘identity device’) can bemanufactured as a smart card. Therefore, the identity device isconnectible to the mobile terminal 100 via the corresponding port.

When the mobile terminal 110 is connected to an external cradle, theinterface unit 170 becomes a passage for supplying the mobile terminal100 with a power from the cradle or a passage for delivering variouscommand signals inputted from the cradle by a user to the mobileterminal 100. Each of the various command signals inputted from thecradle or the power can operate as a signal enabling the mobile terminal100 to recognize that it is correctly loaded in the cradle.

The controller 180 typically controls the overall operations of themobile terminal 100. For example, the controller 180 performs thecontrol and processing associated with voice calls, data communications,video calls, etc. The controller 180 may include a multimedia module 181that provides multimedia playback. The multimedia module 181 may beconfigured as part of the controller 180, or implemented as a separatecomponent.

Moreover, the controller 180 is able to perform a pattern recognizingprocess for recognizing a writing input and a picture drawing inputcarried out on the touchscreen as characters or images, respectively.

The power supply unit 190 provides power required by the variouscomponents for the mobile terminal 100. The power may be internal power,external power, or combinations thereof.

Various embodiments described herein may be implemented in acomputer-readable medium using, for example, computer software,hardware, or some combination thereof. For a hardware implementation,the embodiments described herein may be implemented within one or moreapplication specific integrated circuits (ASICs), digital signalprocessors (DSPs), digital signal processing devices (DSPDs),programmable logic devices (PLDs), field programmable gate arrays(FPGAs), processors, controllers, micro-controllers, microprocessors,other electronic units designed to perform the functions describedherein, or a selective combination thereof. Such embodiments may also beimplemented by the controller 180.

For a software implementation, the embodiments described herein may beimplemented with separate software modules, such as procedures andfunctions, each of which perform one or more of the functions andoperations described herein. The software codes can be implemented witha software application written in any suitable programming language andmay be stored in memory such as the memory 160, and executed by acontroller or processor, such as the controller 180.

FIG. 2 is a front perspective diagram of a mobile terminal according toone embodiment of the present invention.

The mobile terminal 100 shown in the drawing has a bar type terminalbody. Yet, the mobile terminal 100 may be implemented in a variety ofdifferent configurations. Examples of such configurations includefolder-type, slide-type, rotational-type, swing-type and combinationsthereof. For clarity, further disclosure will primarily relate to abar-type mobile terminal 100. However such teachings apply equally toother types of mobile terminals.

Referring to FIG. 2, the mobile terminal 100 includes a case (casing,housing, cover, etc.) configuring an exterior thereof. In the presentembodiment, the case can be divided into a front case 101 and a rearcase 102. Various electric/electronic parts are loaded in a spaceprovided between the front and rear cases 101 and 102. Optionally, atleast one middle case can be further provided between the front and rearcases 101 and 102 in addition.

The cases 101 and 102 are formed by injection molding of synthetic resinor can be formed of metal substance such as stainless steel (STS),titanium (Ti) or the like for example.

A display 151, an audio output unit 152, a camera 121, user input units130/131 and 132, a microphone 122, an interface 180 and the like can beprovided to the terminal body, and more particularly, to the front case101.

The display 151 occupies most of a main face of the front case 101. Theaudio output unit 151 and the camera 121 are provided to an areaadjacent to one of both end portions of the display 151, while the userinput unit 131 and the microphone 122 are provided to another areaadjacent to the other end portion of the display 151. The user inputunit 132 and the interface 170 can be provided to lateral sides of thefront and rear cases 101 and 102.

The input unit 130 is manipulated to receive a command for controllingan operation of the terminal 100. And, the input unit 130 is able toinclude a plurality of manipulating units 131 and 132. The manipulatingunits 131 and 132 can be named a manipulating portion and may adopt anymechanism of a tactile manner that enables a user to perform amanipulation action by experiencing a tactile feeling.

Content inputted by the first or second manipulating unit 131 or 132 canbe diversely set. For instance, such a command as start, end, scroll andthe like is inputted to the first manipulating unit 131. And, a commandfor a volume adjustment of sound outputted from the audio output unit152, a command for a switching to a touch recognizing mode of thedisplay 151 or the like can be inputted to the second manipulating unit132.

Interconnected operational mechanism between the display 151 and thetouchpad 135 are explained with reference to FIG. 3 as follows.

FIG. 3 is a front-view diagram of a terminal according to one embodimentof the present invention for explaining an operational state thereof.

First of all, various kinds of visual information can be displayed onthe display 151. And, theses information can be displayed in characters,numerals, symbols, graphics, icons and the like.

In order to input the information, at least one of the characters,numerals, symbols, graphics and icons are represented as a singlepredetermined array to be implemented in a keypad formation. And, thiskeypad formation can be so-called ‘soft keys’.

FIG. 3 shows that a touch applied to a soft key is inputted through afront face of a terminal body.

The display 151 is operable through an entire area or by being dividedinto a plurality of regions. In the latter case, a plurality of theregions can be configured interoperable.

For instance, an output window 151 a and an input window 151 b aredisplayed on the display 151. A soft key 151 c′ representing a digit forinputting a phone number or the like is outputted to the input window151 b. If the soft key 151 c′ is touched, a digit corresponding to thetouched soft key is outputted to the output window 151 a. If the firstmanipulating unit 131 is manipulated, a call connection for the phonenumber displayed on the output window 151 a is attempted.

Besides, the display 151 or the touchpad 135 can be configured toreceive a touch input by scroll. A user scrolls the display 151 or thetouchpad 135 to shift a cursor or pointer located at an entity (e.g.,icon or the like) displayed on the display 151. Furthermore, in casethat a finger is shifted on the display 151 or the touchpad 135, a pathof the shifted finger can be visually displayed on the display 151. Thismay be useful in editing an image displayed on the display 151.

To cope with a case that both of the display (touch screen) 151 and thetouchpad 135 are touched together within a predetermined time range, onefunction of the terminal can be executed. The above case of thesimultaneous touch may correspond to a case that the terminal body isheld by a user using a thumb and a first finger (clamping). The abovefunction can include activation or deactivation for the display 151 orthe touchpad 135.

Meanwhile, such a graphic for pointing at a specific object on a displayunit or selecting a menu from the display unit as an arrow, a finger andthe like is called a pointer or a cursor. Yet, the pointer is frequentlyused to mean a finger, a stylus pen or the like for a touch manipulationand the like. In order to clearly discriminate the pointer and thecursor from each other in this disclosure, a graphic displayed on adisplay unit is named a cursor and such a physical means for performinga touch, a proximity touch, a gesture and the like as a finger, a styluspen and the like is named a pointer.

In the following description, a method of displaying a 3D image in amobile terminal applicable to embodiments of the present invention and adisplay unit configuration for the same are explained.

First of all, 3D images implemented on the display unit 151 of themobile terminal 100 according to can be mainly classified into two kindsof categories. In this case, the reference for this classification isattributed to whether different images are provided to both eyes,respectively.

The first 3D image category is described as follows.

First of all, the first category is a monoscopic scheme of providing thesame image to both eyes and is advantageous in that it can beimplemented with a general display unit 151. In particular, thecontroller 180 arranges a polyhedron generated from combining at leastone of dots, lines, surfaces or combination thereof in a virtual 3Dspace and enables an image, which is generated from seeing thepolyhedron in a specific view, to be displayed on the display unit 151.Therefore, such a stereoscopic image can substantially include a planarimage.

Secondly, the second category is a stereoscopic scheme of providingdifferent image to both eyes, respectively, which uses the principlethat a user can sense a stereoscopic effect in looking at an object withhuman eyes. In particular, human eyes are configured to see differentplanar images in looking at the same object due to a distance betweenboth eyes. These different images are forwarded to a human brain viaretinas. The human brain is able to sense depth and reality of a 3Dimage by combining the different images together. Therefore, thebinocular disparity attributed to the distance between both of the eyesenables the user to sense the stereoscopic effect despite that there isan individual difference of the binocular disparity more or less.Therefore, the binocular disparity becomes the most important factor ofthe second category. The binocular disparity is explained in detail withreference to FIG. 4 as follows.

FIG. 4 is a diagram for explaining the principle of binocular disparity.

Referring to FIG. 4, assume a situation that a hexahedron 410 ispositioned as a subject in front below an eye's height to be seenthrough human eyes. In this case, a left eye is able to see a left eyeplanar image 420 revealing three facets including a top side, a frontside and a left lateral side of the hexahedron 410 only. And, a righteye is able to see a right eye planar image 430 revealing three facetsincluding the top side, the front side and a right lateral side of thehexahedron 410 only.

Even if a real thing is not actually positioned in front of both eyes ofa user, if the left eye planar image 420 and the right eye planar image430 are set to arrive at the left eye and the right eye, respectively, auser is able to substantially sense the hexahedron 410 as if looking atthe hexahedron 31 actually.

Thus, in order to implement the 3D image belonging to the secondcategory in the mobile terminal 100, images of the same object shouldarrive at both eyes in a manner of being discriminated from each otherfor the left and right eye images of the same object with apredetermined parallax.

In order to discriminate the above-mentioned two categories from eachother in this disclosure, a stereoscopic image belonging to the firstcategory shall be named ‘monoscopic 3D image’ and a stereoscopic imagebelonging to the second category shall be named ‘3D stereoscopic image’.

A method of implementing a 3D stereoscopic image is described asfollows.

First of all, as mentioned in the following description, in order toimplement a 3D stereoscopic image, an image for a right eye and an imagefor a left eye need to arrive at both eyes in a manner of beingdiscriminated from each other. For this, various methods are explainedas follows.

1) Parallax Barrier Scheme

The parallax barrier scheme enables different images arrive at both eyesin a manner of controlling a propagating direction of light byelectronically driving a cutoff device provided between a generaldisplay and both eyes.

A structure of a parallax barrier type display unit 151 for displaying a3D image can be configured in a manner that a general display device iscombined with a switch LC (liquid crystals). A propagating direction oflight is controlled by activating an optical parallax barrier providedto the switch LC, whereby the light is separated into two differentlights to arrive at left and right eyes, respectively. Thus, when animage generated from combining an image for the right eye and an imagefor the left eye together is displayed on the display device, a usersees the images corresponding to the eyes, respectively, thereby feelingthe 3D or stereoscopic effect.

Alternatively, the parallax barrier is electrically controlled to enableentire light to be transmitted therethrough, whereby the lightseparation due to the parallax barrier is avoided. Therefore, the sameimage can be seen through left and right eyes. In this case, the samefunction of a conventional display unit is available.

Meanwhile, the parallax barrier provides a 3D stereoscopic image withreference to one axis. Yet, the present invention is able to use aparallax barrier that enables parallel translation in at least two axialdirections according to a control signal from the controller 180.

2) Lenticular

The lenticular scheme relates to a method of using a lenticular screenprovided between a display and both eyes. In particular, a propagatingdirection of light is refracted via lens on the lenticular screen,whereby different images arrive at both eyes, respectively.

3) Polarized Glasses

According to the polarized glasses scheme, polarizing directions are setorthogonal to each other to provide different images to both eyes,respectively. In case of circular polarization, polarization isperformed to have different rotational direction, whereby differentimages can be provided to both eyes, respectively.

4) Active Shutter

This scheme is a sort of the glasses scheme. In particular, a right eyeimage and a left eye image are alternately displayed on a display unitwith prescribed periodicity. And, user's glasses close its shutter in anopposite direction when an image of a corresponding direction isdisplayed. Therefore, the image of the corresponding direction canarrive at the eyeball in the corresponding direction. Namely, while theleft eye image is being displayed, a shutter of the right eye is closedto enable the left eye image to arrive at the left eye only. On thecontrary, while the right eye image is being displayed, a shutter of theleft eye is closed to enable the right eye image to arrive at the righteye only.

For clarity of description, a mobile terminal mentioned in the followingdescription is assumed as including at least one of the components shownin FIG. 1. In particular, a mobile terminal according to the presentinvention includes a display unit capable of displaying a 3D userinterface including a 3D object by at least one method among theabove-mentioned monoscopic 3D image and 3D stereoscopic imageimplementing schemes. In this case, the 3D object means a polyhedrongenerated from combining at least one of dots, lines, surfaces orcombination thereof in a manner of having a prescribed 3D depth in avirtual stereoscopic space. And, the 3D user interface means a graphicuser interface (GUI) including at least one 3D object. Therefore, incase that a 3D user interface is implemented into a monoscopic 3D image,it means that a user is provided with a planar image generated fromseeing the 3D user interface including a 3D object in a specific view.In case that a 3D user interface is implemented into a 3D stereoscopicimage, it means that left and right eye images generated from seeing the3D user interface in a specific view are provided to arrive atcorresponding eyes of a user, respectively.

Display State Change of 3D User Interface

A mobile terminal and controlling method thereof according to oneembodiment of the present invention are provided. In particular,according to one embodiment of the present invention, when a 3D userinterface including at least one 3D object in a virtual stereoscopicspace is displayed on a display unit, if at least one partial region ofthe 3D user interface is selected, a display state of the selectedregion can be changed according to a user input.

FIG. 5 is a flowchart for one example of a method of controlling a 3Duser interface implemented in a mobile terminal according to oneembodiment of the present invention.

Referring to FIG. 5, a 3D user interface can be activated on the displayunit 151 by means of a prescribed command input through the user inputunit 130 or an application executed as default simultaneously with apower application [S501].

In this case, the present invention is non-limited by a type and form ofa 3D user interface. For instance, a 3D user interface can correspond toone method for displaying a main menu displayed on a wallpaper in amobile terminal or can include a user interface provided by an augmentedreality application.

Subsequently, a display state change mode can be executed if a userperforms a prescribed menu manipulation through the user input unit[S502]. Alternatively, the display state change mode can be executed asdefault according to a setting of a corresponding user interface [S502].

In this case, the display state change mode means a mode that adisplayed state of at least one portion of a 3D user interface can bechanged to correspond to a user's command input.

Once the display state change mode is executed, it is able to designatea display state change region corresponding to a region for changing astate on the 3D user interface by means of a user's input [S503].

In this case, the display state change region becomes at least onepartial space of a virtual space displayed on a 3D user interface. Inorder to designate such a space, if one facet of a polyhedron enclosingthe corresponding space is first selected, it is able to use a method offorming a polygonal pillar in prescribed height with a base side set tothe selected facet. Alternatively, it is able to use a method for a userto directly designate a height of the polygonal pillar through aprescribed input. A detailed implementation of designating the presentregion shall be explained later.

Once the display sate change region is designated, a polyhedron of aprescribed shape including the corresponding region, i.e., a changeregion polyhedron is generated. And, the generated change regionpolyhedron can be displayed with a prescribed visual effect [S504].

In doing so, the change region polyhedron is enlarged or reduced at aprescribed ratio to be greater or smaller than the selected displaystate change region. The enlarged/reduced change region polyhedron isdisplayed as an OSD (on screen display) by being overlaid on the 3D userinterface or can be displayed on a separate region or window.

Moreover, the change region polyhedron can be displayed as a 3Dstereoscopic image. In this case, the change region polyhedron can bedisplayed as the 3D stereoscopic image only. Alternatively, a wholedisplay can be displayed as a 3D stereoscopic image as soon as thechange region polyhedron is displayed. For this, the controller 180 isable to give a different 3D depth to each of the change regionpolyhedron and a 3D user interface except the change region polyhedron.Consequently, a user is able to feel the change region polyhedron as ifthe change region polyhedron is located closer to the user than the restof the 3D user interface except the change region polyhedron (i.e., asif the change region polyhedron seems to float.

If the change region polyhedron is displayed, the user is able to inputa command for shifting(scrolling)/enlarging/reducing the polyhedron viaa prescribed menu manipulation or a touchscreen provided to the mobileterminal [S505].

If such a command is inputted, a display state of the polyhedron ischanged. The changed display state can be then displayed on the displayunit [S506].

One change region polyhedron is selected in the description withreference to FIG. 5, by which the present invention is non-limited. Forinstance, a plurality of change region polyhedrons can be selected. Ifso, a user is able to change a display state of each of a plurality ofthe change region polyhedrons by manipulating the corresponding changeregion polyhedron selectively.

In the following description, a method of changing a display state of a3D user interface according to one embodiment of the present inventionis explained in detail using a detailed form of the 3D user interface.

FIG. 6 is a diagram for one example of a display form of a 3D userinterface implemented in a mobile terminal according to one embodimentof the present invention.

Referring to FIG. 6, assume that a 3D user interface is provided via anapplication for informing a user of perimeter location information. Inparticular, as a perimeter location information related application isexecuted on the display unit, a triangular pillar type building 610, arectangular pillar type building 620 and a user's current position 630can be displayed on a 2D map [FIG. 6 (a)]. In this case, as the userchanges the 2D map into a 3D form via a prescribed menu manipulation, a3D map representing each of the buildings as a 3D object can bedisplayed via a 3D user interface [FIG. 6 (b)].

In the following description, a configuration of a display form changeregion is explained with reference to FIG. 7.

FIG. 7 is a diagram for one example of a change region polyhedron formdisplayed if a prescribed region of a 3D user interface displayed on amobile terminal according to one embodiment of the present invention isdesignated to a display state change region.

Referring to FIG. 7, assume a case that a display state change region isdesignated by a prescribed method while such a 3D user interface asshown in FIG. 6 (b) is displayed.

First of all, a display form change region 710 can be designated as acube form including a rectangular pillar type building 620 [FIG. 7 (a)].

If the display form change region is designated, a change regionpolyhedron (e.g., a cube form) can be displayed as shown in FIG. 7 (b)or FIG. 7 (c). In particular, referring to FIG. 7 (b), an image of afront view of a corresponding facet can be displayed on each facet ofthe change region polyhedron. Referring to FIG. 7 (c), an image of aprescribed region of the chance region polyhedron seen in the same viewof viewing the 3D user interface can be displayed on each facet of thechange region polyhedron.

In the following description, a method of designating a display statechange region is explained with reference to FIG. 8.

FIG. 8 is a diagram for one example of a method of designating a displaystate change region to a 3D user interface according to one embodimentof the present invention.

Referring to FIG. 8, assume that the display unit 151 includes atouchscreen configured to recognize a user's touch input. Assume thatthe display state change region is selected in a following manner. Firstof all, a display state change region is a polygonal pillar type.Secondly, after a polygon becoming a base side of a polygonal pillar hasbeen designated, a height is given to the designated polygon.

Before a 3D user interface is activated as shown in FIG. 6 (a), it isable to use a method of selecting a polygon, which starts from a startpoint 810 and then returns to the start point, by a drag input via apointer 800 [FIG. 8 (a)]. In this case, a contour line of the polygoncan be displayed along a trace of the drag input on the display unit byhaving a prescribed visual effect given thereto.

Once the pointer 800 arrives at the start point 810 of the drag input, aprescribed visual effect 830 can be given to the selected polygon [FIG.8 (b)]. In this case, as mentioned in the foregoing assumption, theselected polygon can become the base side of the display state change.region. In particular, by giving a preset height or a user selectedheight to a corresponding polygon, a polygonal pillar having its baseside set to the corresponding polygon can be designated to the displaystate change region.

Meanwhile, if the 3D user interface is already activated, a polygon 830,which becomes a base side of a polygonal pillar corresponding to adisplay state change region, is first designated and a pointer 800 isthen dragged to designate a height of the polygonal pillar [FIG. 8 (c)].

Hence, it is able to select such a display state change region 840 asshown in FIG. 8 (d).

In the aforesaid display state change region designating method, thestep of drawing a polygon using a drag input can be replaced by a stepof touching apexes of a polygon of the same shape in turn. In doing so,it is able to change a form and/or size of the polygon in a manner ofdragging one of the apexes of the polygon.

Alternatively, if a specific 3D object is selected, a polyhedronincluding all corresponding objects can be directly selected as adisplay state change region. For instance, if the rectangular pillartype building 620 is touched in FIG. 7 (a), a virtual spacecorresponding to (or greater by a prescribed ratio than) a specificbuilding in a 3D user interface can be designated to the display statechange region.

In the following description, a process for displaying a selecteddisplay state change region as a change region polyhedron is explainedwith reference to FIG. 9.

FIG. 9 is a diagram for one example of a form of displaying a changeregion polyhedron on a 3D user interface in a mobile terminal accordingto one embodiment of the present invention.

Referring to FIG. 9, if a display state change region 910 is selectedfrom a 3D user interface [FIG. 9 (a)], a change region polyhedron 920 ofa form generated from enlarging the display state change region at aprescribed ratio can be displayed in a manner of being overlaid on the3D user interface [FIG. 9 (b)]. In doing so, a 3D depth lower than thepreviously displayed 3D user interface can be given to the change regionpolyhedron (i.e., the change region polyhedron looks as if locatedcloser to a user than the 3D user interface). Moreover, the changeregion polyhedron 920 can be displayed in a manner of being enlargedlarger than the selected display state change region 910.

Alternatively, the change region polyhedron can be displayed as aseparate region or window on the display unit 151 in a manner of havinga transparent effect given thereto or avoiding being overlapped with the3D user interface as well as being displayed by being overlaid on the 3Duser interface.

In the following description, a detailed form of changing a displaystate of a change region polyhedron by manipulating the displayed changeregion polyhedron is explained with reference to FIGS. 10 to 14.

In the following drawings including FIG. 10, a change region polyhedron,which is generated using a display state change region selected from arandom 3D user interface by one of the aforesaid methods, is displayedas a cube (i.e., hexahedron). For clarity of the following description,a different schematic diagram is displayed on each facet of the cube forthe purpose of discrimination.

FIG. 10 is a diagram for one example of a method of scrolling a changeregion polyhedron in a mobile terminal according to one embodiment ofthe present invention.

Referring to FIG. 10 (a), a change region polyhedron 1000 of a cube typeis displayed. When the change region polyhedron 1000 is displayed, anicon box 1010 for changing a display state of the change regionpolyhedron can be displayed as default automatically according to asetting. Alternatively, the icon box 1010 can be displayed if aprescribed command is inputted by a user via the user input unit 130.

In the icon box 1010 for changing the display state, a scroll mode icon1011, a rotate mode icon, an enlarge/reduce mode icon and the like canbe included.

If the user selects the scroll mode icon 1011, a scroll key button 1020for right and left scrolls and a scroll key button 1030 for top andbottom scrolls can be displayed in the vicinity of the change regionpolyhedron.

If the user manipulates the scroll key button 1025 corresponding to aleft direction, referring to FIG. 10 (b), an image displayed on eachfacet of the change region polyhedron 1000 can be scrolled. In dong so,an image of the facet vertical to the scroll direction may not bescrollable.

In the following description, a method of rotating a change regionpolyhedron is explained with reference to FIG. 11.

FIG. 11 is a diagram for one example of a method of rotating a changeregion polyhedron in a mobile terminal according to one embodiment ofthe present invention.

Referring to FIG. 11 (a), assume a case that the rotate mode icon 1013in the icon box 1010 is selected in the situation similar to that shownin FIG. 10 (a). Hence, a horizontal scroll key button 1040 and avertical scroll key button 1050 can be displayed in the vicinity of thechange region polyhedron.

If a user manipulates a scroll key button 1045 corresponding to ahorizontal clockwise direction, referring to FIG. 11 (b), it is able torotate the change region polyhedron 1000 in the corresponding direction.

In the following description, a method of enlarging/reducing a changeregion polyhedron is explained with reference to FIG. 12.

FIG. 12 is a diagram for one example of a method of enlarging/reducing achange region polyhedron in a mobile terminal according to oneembodiment of the present invention.

Referring to FIG. 12 (a), assume a case that the enlarge/reduce modeicon 1015 in the icon box 1010 is selected in the situation similar tothat shown in FIG. 10 (a). Hence, an enlarge key button 1210 and areduce key button 1220 can be displayed in the vicinity of the changeregion polyhedron.

If a user manipulates the enlarge key button 1210, referring to FIG. 12(b), an image displayed on each facet of the change region polyhedron1000 can be enlarged. If a user manipulates the reduce key button 1220,referring to FIG. 12 (c), an image displayed on each facet of the changeregion polyhedron 1000 can be reduced.

In the above described scrolling or enlarging/reducing method, the keybutton for performing each function preferably includes a virtual keybutton that can be manipulated via a touch input or a pointer by beingdisplayed on the display unit. If the corresponding key button is notdisplayed on the display unit, it can be replaced by a prescribedhardware key button provided to the user input unit 130.

Meanwhile, in order to scroll or enlarge/reduce the change regionpolyhedron, it is able to use a touch input to the change regionpolyhedron instead of the key buttons described with reference to FIGS.10 to 12. This is explained with reference to FIG. 13 as follows.

FIG. 13 is a diagram for one example of manipulating a change regionpolyhedron via a touch input in a mobile terminal according to oneembodiment of the present invention.

Referring to FIG. 13, assume that the display unit 151, on which achange region polyhedron is displayed, includes a touchscreen.

Referring to FIG. 13 (a), a user performs a touch & drag input in afollowing manner to rotate a change region polyhedron [FIG. 13 (b)].First of all, a user applies a touch input to one point on a changeregion polyhedron via a pointer 800, shifts the corresponding touch toanother point by maintaining the touched state, and then releases thetouch input.

Moreover, the user is able to enlarge an image displayed on each facetof the change region polyhedron [FIG. 13 (d)] by a method (i.e.,multiple touch & drag) of simultaneously applying touch & drag inputs tothe change region polyhedron using two pointers 800 and 805 set to getfarther from initially touched points, respectively [FIG. 13 (c)]. Incase that the touch & drag input is applied in a manner of gettingcloser to the initially touched point of each of the pointers, the imagedisplayed on each facet of the change region polyhedron can be reduced.

Meanwhile, in another aspect of the present embodiment, it is able toenlarge one facet of a change region polyhedron again. This is explainedwith reference to FIG. 14 as follows.

FIG. 14 is a diagram for one example of a method of enlarging anddisplaying one facet of a change region polyhedron in a mobile terminalaccording to one embodiment of the present invention.

Referring to FIG. 14, assume a following situation. First of all, achange region polyhedron is displayed on a touchscreen. Secondly, theaforesaid icon box 1010 is not activated. Thirdly, the aforesaidmanipulation of the change region polyhedron using the touch, which isdescribed with reference to FIG. 13, is not applicable.

Referring to FIG. 14 (a), when a change region polyhedron 1000 isdisplayed, it is able to designate a region 1410 to enlarge using apointer 800 in order to enlarge an image displayed on a front facet ofthe change region polyhedron.

Accordingly, referring to FIG. 14 (b), it is able to display an imagegenerated from enlarging the designated region at a prescribed ratio ina manner that a 3D depth lower than that of the change region polyhedron1000 is given to the displayed image.

Besides, the aforesaid method of enlarging at least one portion of thefacet can be combined with the aforesaid change region polyhedronmanipulating method in various ways.

Plural Change Region Polyhedrons

Meanwhile, according to another embodiment of the present invention, atleast two change region polyhedrons are selected and can be thensimultaneously or selectively displayed. For this, a method ofgenerating a plurality of change region polyhedrons and display form ofthe change region polyhedrons are described with reference to FIG. 15and FIG. 16 as follows, respectively.

FIG. 15 is a diagram for one example of a method of selecting aplurality of display state change regions in a mobile terminal accordingto another embodiment of the present invention.

Referring to FIG. 15, assume the followings. First of all, the displayunit 151 includes a touchscreen configured to recognize a user's touchinput. Secondly, a display state change region has a cube form. Thirdly,the display state change region is selected in a manner of designating arectangle becoming a base side of the cube and then giving a height tothe designated base side. Fourthly, a 3D user interface displayed on atouchscreen is an application for informing a user of such perimeterlocation information a shown in FIG. 6.

Referring to FIG. 15 (a), in order to designate a display state changeregion of a cube type to a 2D map, a user performs a drag input with atrace 1510 corresponding to a base side of the cube around a rectangularpillar type building using a pointer 1500.

If the base side of the cube is specified (i.e., a closed loop iscompleted in a manner that a drag trace meets a start point), it is ableto display a menu window 1530 for querying whether a selection of thecube base side is completed [FIG. 15 (b)]. In this case, the menu window1530 includes a complete menu 1531 indicating a selection completion, anadditional select menu 1531 indicating that another display state changeregion is additionally designated and a cancel menu 1537 for canceling aprevious selection.

If the user selects the complete menu 1531, the routine goes to a stepof determining a height from the selected base side (cf. FIG. 15 (d)).If the cancel menu 1537 is selected by the user, the routine goes backto the step shown in FIG. 15 (a).

If the user selects the additional select menu 1535, referring to FIG.15 (c), the menu window 1530 disappears and a prescribed visual effectis given to the previously selected base side 1550. In this case, theuser is able to select a base side of a second display state changeregion by performing a drag input in a manner of drawing a closed loopwith a trace 1560 corresponding to a perimeter of a triangular pillartype building.

If the selection of the second base side is completed, the menu window1530, as shown in FIG. 15 (b), is displayed again. In this case, assumethat the user selects the complete menu 1531.

If the complete menu 1531 is selected, referring to FIG. 15 (d), the 2Dmap is switched to a 3D map and the base sides 1550 and 1565 selected inthe previous steps are displayed. In this case, it is able to determinea height of the corresponding display state change region by a draginput starting with one point 1555 of the base side 1550 selected as therectangular pillar type building perimeter. In particular, a releasepoint of the drag & touch input becomes the height of the correspondingdisplay state change region.

If the height determination is completed, a prescribed visual effect1580 is given to indicate that the display state change region has beendetermined [FIG. 15 (e)]. And, a height of the second display statechange region can be determined by a drag input starting with one point1567 of the base side 1565 selected as the perimeter of the triangularpillar type building.

FIG. 15 shows the method of selecting two display state change regionssimultaneously, by which the present invention is non-limited. Forexample, after one display state change region has been selected,another display state change region can be selected additionally fromthe step shown in FIG. 15 (c) by a prescribed menu manipulation.

FIG. 15 shows how two display state change regions are selected, bywhich the present invention is non-limited. For example, it is apparentto those skilled in the art that more display state change regionsshould be selectable.

In the following description a form of displaying a change regionpolyhedron and method of changing a display state of the change regionpolyhedron are explained with reference to FIG. 16.

FIG. 16 is a diagram for one example of a form of displaying a pluralityof change region polyhedrons in a mobile terminal according to anotherembodiment of the present invention.

Referring to FIG. 16, assume a situation after completion of the stepsshown in FIG. 15.

Referring to FIG. 16 (a), two display state change regions are changedand displayed as change region polyhedrons 1610 and 1620, respectively.As mentioned in the foregoing description with reference to FIG. 9 (b),a prescribed visual effect can be given to each of the change regionpolyhedrons. Moreover, as mentioned in the foregoing description withreference to FIGS. 10 to 12, the icon boxes 1630 and 1640 are displayedin the vicinity of the change region polyhedrons to change the displaystates of the polyhedrons, respectively. As the description of the iconbox is similar to that of the former icon box, the redundant descriptionshall be omitted from the following description for clarity. Besides,the former display state changing method described with reference toFIG. 13 and FIG. 14 are applicable as well.

Referring to FIG. 16 (b), a form of displaying the change regionpolyhedrons is similar to that shown in FIG. 16 (a). Yet, thumbnails1650 and 1660 for the change region polyhedrons are additionallydisplayed. If a user selects the thumbnail 1660 corresponding to thechange region polyhedron 1610 including the rectangular pillar typebuilding using a pointer 1600, a prescribed visual effect can be givento the selected thumbnail 1660 to indicate the corresponding selection.Afterwards, the user is able to change the display state of the selectedchange region polyhedron 1610 via an icon box 1670 displayed in thevicinity of the corresponding thumbnail 1660.

In this case, referring to FIG. 16 (c), if the user selects thethumbnail 1650 corresponding to the change region polyhedron 1620including the triangular pillar type building, the change regionpolyhedron 1620 including the triangular pillar type building blocked bythe change region polyhedron 1610 including the rectangular pillar typebuilding is displayed on a highest level. In doing so, if eachpolyhedron is displayed as a 3D stereoscopic image, the 3D depth of theselected polyhedron is further lowered to enable the user to feel as ifthe selected polyhedron is closer to the user. Afterwards, if the usermanipulates the icon box 1670, the controller 180 recognizes themanipulation as an input for changing the display state of the selectedpolyhedron 1620.

According to one embodiment of the present invention, theabove-described methods can be implemented in a program recorded mediumas computer-readable codes. The computer-readable media include allkinds of recording devices in which data readable by a computer systemare stored. The computer-readable media include ROM, RAM, CD-ROM,magnetic tapes, floppy discs, optical data storage devices, and the likefor example and also include carrier-wave type implementations (e.g.,transmission via Internet).

The aforementioned embodiments are achieved by combination of structuralelements and features of the present invention in a predetermined type.Each of the structural elements or features should be consideredselectively unless specified separately. Each of the structural elementsor features may be carried out without being combined with otherstructural elements or features. Also, some structural elements and/orfeatures may be combined with one another to constitute the embodimentsof the present invention.

It will be apparent to those skilled in the art that variousmodifications and variations can be made in the present inventionwithout departing from the spirit or scope of the inventions. Thus, itis intended that the present invention covers the modifications andvariations of this invention provided they come within the scope of theappended claims and their equivalents.

Accordingly, the present invention is directed to a mobile terminal andcontrolling method thereof that substantially obviate one or moreproblems due to limitations and disadvantages of the related art.

An object of the present invention is to provide a mobile terminal andcontrolling method thereof, by which a more convenient 3D userinterface3D user interface can be provided.

In particular, the present invention provides a mobile terminal andcontrolling method thereof, by which a display state of a designatedregion can be conveniently changed in a manner of designating aprescribed region to a stereoscopic user object including a 3D objectpositioned in a virtual 3D space.

Additional advantages, objects, and features of the invention will beset forth in part in the description which follows and in part willbecome apparent to those having ordinary skill in the art uponexamination of the following or may be learned from practice of theinvention. The objectives and other advantages of the invention may berealized and attained by the structure particularly pointed out in thewritten description and claims hereof as well as the appended drawings.

To achieve these objects and other advantages and in accordance with thepurpose of the invention, as embodied and broadly described herein, amobile terminal according to the present invention includes a user inputunit configured to receive an input of a command from a user, a displayunit configured to display a 3D user interface3D user interface forarranging at least one 3D object having a prescribed 3D depth in avirtual stereoscopic space, and a controller, if at least one partialstereoscopic region is selected from the 3D user interface3D userinterface according to a first input via the user input unit,controlling a polyhedron including the selected stereoscopic region tobe displayed on the display unit, the controller controlling a displaystate of the polyhedron to be changed to correspond to a second inputvia the user input unit. In this case, a change of the display stateincludes at least one selected from the group consisting of enlargement,reduction, rotation and scroll of the polyhedron.

In another aspect of the present invention, a mobile terminal includes atouchscreen configured to display a 3D user interface3D user interfacefor arranging at least one 3D object as a prescribed form in a virtualstereoscopic space and a controller, if at least one stereoscopic regionis selected from the 3D user interface3D user interface by a first inputvia the touchscreen, controlling at least one polyhedron correspondingto each of the selected at least one stereoscopic region to be displayedon the touchscreen, the controller controlling a display state of eachof the at least one polyhedron to be changed to correspond to a secondinput via the touchscreen. In this case, a change of the display stateincludes at least one selected from the group consisting of enlargement,reduction, rotation and scroll of the polyhedron.

In another aspect of the present invention, a method of controlling amobile terminal includes the steps of displaying a 3D user interface3Duser interface including at least one 3D object on a display unit,selecting at least one stereoscopic region from the 3D user interface bya first input via a user input unit, displaying at least one polyhedroncorresponding to each of the selected at least one stereoscopic regionon the display unit, and changing a display state of each of the atleast one polyhedron to correspond to a second input via the user inputunit. In this case, the step of changing the display state is performedto enlarge, reduce, rotate or scroll the at least one polyhedronaccording to the second input.

Accordingly, the present invention provides the following effects and/oradvantages.

First of all, a user is facilitated to manipulate a mobile terminalaccording to at least one embodiment of the present invention using a 3Duser interface.

Secondly, the present invention facilitates a user to change a displaystate of a 3D user interface including a 3D object positioned in a 3Dspace.

It is to be understood that both the foregoing general description andthe following detailed description of the present invention areexemplary and explanatory and are intended to provide furtherexplanation of the invention as claimed.

Any reference in this specification to “one embodiment,” “anembodiment,” “example embodiment,” etc., means that a particularfeature, structure, or characteristic described in connection with theembodiment is included in at least one embodiment of the invention. Theappearances of such phrases in various places in the specification arenot necessarily all referring to the same embodiment. Further, when aparticular feature, structure, or characteristic is described inconnection with any embodiment, it is submitted that it is within thepurview of one skilled in the art to affect such feature, structure, orcharacteristic in connection with other ones of the embodiments.

Although embodiments have been described with reference to a number ofillustrative embodiments thereof, it should be understood that numerousother modifications and embodiments can be devised by those skilled inthe art that will fall within the spirit and scope of the principles ofthis disclosure. More particularly, various variations and modificationsare possible in the component parts and/or arrangements of the subjectcombination arrangement within the scope of the disclosure, the drawingsand the appended claims. In addition to variations and modifications inthe component parts and/or arrangements, alternative uses will also beapparent to those skilled in the art.

What is claimed is:
 1. A mobile terminal comprising: a user input unitto receive inputs; a display unit to display a perceived 3-Dimensional(3D) user interface for arranging at least one 3D object on a 3D space;and a controller to control the display unit such that when auser-determined 3D polyhedral space is selected from the displayed 3Duser interface based on a first input received via the user input unit,the controller controls the display unit to display a polyhedron thatincludes the user-determined 3D polyhedral space, and the controller tochange a display state of the displayed polyhedron based on a secondinput received via the user input unit, wherein the controller changesthe display state of the polyhedron by enlarging, reducing, rotating orscrolling the displayed polyhedron, wherein the perceived 3-Dimensional(3D) user interface includes a map application, and each of the at leastone 3D object corresponds to a geographical object, wherein the firstinput includes a first drag input for determining a region correspondingto a base side of the at least one 3D polyhedral space and a second draginput, after the first drag input is released, for determining a heightof the at least one user- determined 3D polyhedral space having the baseside, wherein the base side of the at least one 3D polyhedral spaceincludes a polygon and the first drag input is for determining thepolygon, which starts from a start point and then returns to the startpoint; and wherein the controller controls the display unit to display amenu window for receiving a confirmation of a presence or a non-presenceof completion of the first drag input, and wherein in response toreceiving an input via the menu window indicating the completion of thefirst drag input, the controller recognizes a next drag input as thesecond drag input.
 2. The mobile terminal of claim 1, wherein thecontroller controls the display unit to display the polyhedron as an onscreen display (OSD) on the 3D user interface by enlarging thepolyhedron.
 3. The mobile terminal of claim 1, wherein in response tothe selection of one facet of the polyhedron based on a third input fromthe user input unit, the controller controls the display unit to enlargea region corresponding to the selected facet.
 4. The mobile terminal ofclaim 1, wherein the polyhedron is displayed as a perceived 3D imagewhile the 3D user interface is displayed.
 5. The mobile terminal ofclaim 1, wherein the user-determined 3D polyhedral space is selectedbased on a first input that includes a first selection input fordetermining a base side of the polyhedron and a second selection input,subsequent to the first selection input, for determining a height of thepolyhedron.
 6. A mobile terminal comprising: a touchscreen to display aperceived 3-Dimensional (3D) user interface for providing at least one3D object on a 3D space, the touchscreen to receive at least a firstinput and a second input; and a controller to select a user-determined3D polyhedral space from the displayed 3D space based on the firstinput, the controller to display at least one polyhedron correspondingto the user-determined 3D polyhedral space, and the controller to changea display state of the at least one polyhedron in response to the secondinput received via the touchscreen, wherein the controller changes thedisplay state of the at least one polyhedron by enlarging, reducing,rotating or scrolling the at least one polyhedron, wherein the perceived3-Dimensional (3D ) user interface includes a map application, and eachof the at least one 3D object corresponds to a geographical object,wherein the first input received via the touchscreen includes a firstdrag input for determining a region corresponding to a base side of theuser-determined 3D polyhedral space and a second drag input, after thefirst input is released, for determining a height of the user-determined3D polyhedral space having the base side, wherein the base side of the3D polyhedral space includes a polygon and the first drag input is fordetermining the polygon, which starts from a start point and thenreturns to the start point, and wherein the controller controls thetouchscreen to display a menu window for receiving a confirmation of apresence or a non-presence of completion of the first drag input, andwherein in response to receiving an input via the menu window indicatingthe completion of the first drag input, the controller recognizes a nextdrag input as the second drag input.
 7. The mobile terminal of claim 6,wherein the controller displays two polyhedrons on the touchscreen, andthe controller controls the touchscreen to provide a same perceived 3Ddepth or a different perceived 3D depth to each of the two polyhedrons.8. The mobile terminal of claim 6, wherein the touchscreen displays atleast one icon corresponding to one of a rotation, a parallel shift, anenlargement or a reduction, and wherein when the at least one icon isselected, the controller recognizes that the second input is receivedand changes the display state of the at least one polyhedron based onthe selected icon.
 9. The mobile terminal of claim 6, wherein thetouchscreen displays at least one thumbnail corresponding to eachdisplayed polyhedron.
 10. The mobile terminal of claim 9, wherein inresponse to receiving an input via the touchscreen regarding selectionof the at least one thumbnail, the controller changes the display stateof the polyhedron corresponding to the selected thumbnail.
 11. Themobile terminal of claim 6, wherein the user-determined 3D polyhedralspace is selected based on a first input that includes a first selectioninput for determining a base side of the polyhedron and a secondselection input, subsequent to the first selection input, fordetermining a height of the polyhedron.
 12. A method of controlling amobile terminal, the method comprising: displaying, on a display unit, aperceived 3-Dimensional (3D ) user interface that includes at least one3D object on a 3D space; determining at least one user-determined 3Dpolyhedral space of the displayed 3D space based on a first input;displaying, on the display unit, at least one polyhedron correspondingto the determined at least one user-determined 3D polyhedral space; andchanging a display state of the at least one polyhedron based on asecond input, wherein changing the display state includes enlarging,reducing, rotating or scrolling the displayed at least one polyhedron,wherein the perceived 3-Dimensional (3D ) user interface includes a mapapplication, and each of the at least one 3D object corresponds to ageographical object, wherein the first input includes a first drag inputfor determining a region corresponding to a base side of the at leastone 3D polyhedral space and a second drag input, after the first draginput is released, for determining a height of the at least one user-determined 3D polyhedral space having the base side, and wherein thebase side of the at least one 3D polyhedral space includes a polygon andthe first drag input is for determining the polygon, which starts from astart point and then returns to the start point, and displaying a menuwindow for receiving a confirmation of a presence or a non-presence ofcompletion of the first drag input, and wherein in response to receivingan input via the menu window indicating the completion of the first draginput, a next drag input is recognized as the second drag input.
 13. Themethod of claim 12, further comprising: displaying, on the display unit,at least one icon corresponding to one of a rotation, a parallel shift,an enlargement or a reduction, and in response to determining theselection of the at least one icon, changing the display state of the atleast one polyhedron based on the selected at least one icon.
 14. Themethod of claim 12, further comprising displaying at least one thumbnailcorresponding to each displayed polyhedron.
 15. The method of claim 14,further comprising determining an input regarding selection of the atleast one thumbnail, and wherein changing the display state of the atleast one polyhedron is based on the selected thumbnail.
 16. The mobileterminal of claim 12, wherein the user-determined 3D polyhedral space isselected based on a first input that includes a first selection inputfor determining a base side of the polyhedron and a second selectioninput, subsequent to the first selection input, for determining a heightof the polyhedron.
 17. A mobile terminal comprising: a display todisplay a perceived 3-Dimensional (3D ) user interface and at least one3D object on a 3D space, wherein the perceived 3-Dimensional (3D ) userinterface includes a map application, and each of the at least one 3Dobject corresponds to a geographical object; and a controller todetermine a user-determined 3D polyhedral space of the displayed 3Dspace based on a first input, the controller to control the display todisplay a polyhedron that includes the user-determined 3D polyhedralspace, the controller to enlarge the displayed polyhedron based on asecond input, and the controller to further change the displayedpolyhedron based on a third input, wherein the first input includes afirst drag input for determining a region corresponding to a base sideof the 3D polyhedral space and a second drag input, after the first draginput is released, for determining a height of the 3D polyhedral spacehaving the base side, wherein the base side of the 3D polyhedral spaceincludes a polygon and the first drag input is for determining thepolygon, which starts from a start point and then returns to the startpoint, and wherein the controller controls the display to display a menuwindow for receiving a confirmation of a presence or a non-presence ofcompletion of the first drag input, and wherein in response to receivingan input via the menu window indicating the completion of the first draginput, the controller recognizes a next drag input as the second draginput.
 18. The mobile terminal of claim 17, wherein the third inputcorresponds to enlarging, reducing, rotating or scrolling the displayedpolyhedron.
 19. The mobile terminal of claim 17, wherein the displaydisplays an icon corresponding to a visual effect, and wherein when theat least one icon is selected, the controller recognizes that the thirdinput is received and changes the at least one polyhedron based on theselected icon.
 20. The mobile terminal of claim 17, wherein theuser-determined 3D polyhedral space is selected based on a first inputthat includes a first selection input for determining a base side of thepolyhedron and a second selection input, subsequent to the firstselection input, for determining a height of the polyhedron.